Experiences and Challenges Scaling PFLOTRAN, a PETSc-based Code for Subsurface Reactive Flow Simulations, Towards the Petascale on Cray XT Systems
نویسندگان
چکیده
We describe our experiences running PFLOTRAN—a code for simulation of coupled hydro-thermal-chemical processes in variably saturated, non-isothermal, porous media—on the Cray XT series of computers, including initial experiences running on the petaflop incarnation of Jaguar, the Cray XT5 at the National Center for Computational Sciences at Oak Ridge National Laboratory. PFLOTRAN utilizes fully implicit time-stepping and is built on top of the Portable, Extensible Toolkit for Scientific Computation (PETSc). We discuss some of the hurdles to “at scale” performance with PFLOTRAN and the progress we have made in overcoming them on the Cray XT4 and XT5 architectures.
منابع مشابه
PFLOTRAN: Reactive Flow & Transport Code for Use on Laptops to Leadership-Class Supercomputers
PFLOTRAN, a next-generation reactive flow and transport code for modeling subsurface processes, has been designed from the ground up to run efficiently on machines ranging from leadership-class supercomputers to laptops. Based on an object-oriented design, the code is easily extensible to incorporate additional processes. It can interface seamlessly with Fortran 9X, C and C codes. Domain decomp...
متن کاملSimulating Subsurface Flow and Transport on Ultrascale Computers using PFLOTRAN
We describe PFLOTRAN, a recently developed code for modeling multi-phase, multicomponent subsurface flow and reactive transport using massively parallel computers. PFLOTRAN is built on top of PETSc, the Portable, Extensible Toolkit for Scientific Computation. Leveraging PETSc has allowed us to develop—with a relatively modest investment in development effort—a code that exhibits excellent perfo...
متن کاملHierarchical Krylov and nested Krylov methods for extreme-scale computing
The solution of large, sparse linear systems is often a dominant phase of computation for simulations based on partial differential equations, which are ubiquitous in scientific and engineering applications. While preconditioned Krylov methods are widely used and offer many advantages for solving sparse linear systems that do not have highly convergent, geometric multigrid solvers or specialize...
متن کاملEvaluating the performance of parallel subsurface simulators: An illustrative example with PFLOTRAN
[1] To better inform the subsurface scientist on the expected performance of parallel simulators, this work investigates performance of the reactive multiphase flow and multicomponent biogeochemical transport code PFLOTRAN as it is applied to several realistic modeling scenarios run on the Jaguar supercomputer. After a brief introduction to the code's parallel layout and code design, PFLOTRAN's...
متن کاملPFLOTRAN: Massively Parallel 3D Simulator for CO2 Sequestration in Geologic Media
Geologic sequestration in depleted oil reservoirs, saline aquifers, etc. has been proposed as an effective way to stabilize the concentration of CO2 in the atmosphere and thus mitigate its effect on global climate change. We have developed a massively parallel 3-D reservoir simulator PFLOTRAN for modeling supercritical CO2 sequestration in geologic formations based on continuum scale mass and e...
متن کامل